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Abstract 

We present some upper bounds on the size of non-linear codes and their restriction to 
systematic codes and hnear codes. These bounds are independent of other known 
theoretical bounds, e.g. the Griesmer bound, the Johnson bound or the Plotkin 
bound, and one of these is actually an improvement of a bound by Litsyn and 
Laihonen. Our experiments show that in some cases (the majority of cases for some 
q) our bounds provide the best value, compared to all other theoretical bounds. 

Keywords: Hamming distance, linear code, systematic code, non-linear code, 
upper bound. 



1 Introduction 



The problem of bounding the size of a code depends heavily on the code 
family that we are considering. In this paper we are interested in three types 
of codes: linear codes, systematic codes and non-linear codes. Referring to 
the subsequent section for rigorous definitions, with linear codes we mean 
linear subspaces of (F^)", while with non-linear codes we mean (following 
consolidated tradition) codes that are not necessarily linear. In this sense, 
a linear code is always a non-linear code, while a non-linear code may be 
a linear code, although it is unlikely. Systematic codes form a less-studied 
family of codes, whose definition is given in the next section. Modulo code 
equivalence all (non-zero) linear codes are systematic and all systematic codes 
are non-linear. In some sense, systematic codes stand in the middle between 
linear codes and non-linear codes. The size of a systematic code is directly 
comparable with that of a linear code, since it is a power of the size of F^. 
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In this paper we are interested only in theoretical bounds, that is, 
bounds on the size of a code that can be obtained by a closed-formula expres- 
sion, although other algorithmic bounds exist (e.g. the Linear Programming 
bound [Del73]). The algebraic structure of linear codes would suggest the 
knowledge of a high number of bounds strictly for linear codes, and only a few 
bounds for the other case. Rather surprisingly, the academic literature reports 
only one bound for linear codes, the Griesmer bound ([Gri60]), no bounds for 
systematic codes and many bounds for non-linear codes. Among those, we re- 
call: the Johnson bound ([Joh62],[Joh71],[HP03]), the Elias-Bassalygo bound 
([Bas65],[HP03]), the Levenshtein bound ([Lev98]), the Hamming (Sphere 
Packing) bound and the Singleton bound ([PBH98]), and the Plotkin bound 
([PI06O], [HP03]). 

Since the Griesmer bound is specialized for linear codes, we would expect it to 
beat the other bounds, but even this does not happen, except in some cases. 
So we have an unexpected situation where the bounds holding for the more 
general case are numerous and beat bounds holding for the specialized case. 

In this paper we present one (closed-formula) bound (Bound A ) for a 
large parte of non-linear codes (including all systematic codes), which is an 
improvement of a bound by Litsyn and Laihonen in [LL98]. The crux of our 
improvement is a preliminary result presented in Section 3, while in Section 
4 we are able to prove Bound A . Then we restrict Bound A to the sys- 
tematic/linear case and compare it with all the before-mentioned bounds by 
computing their values for a large set of parameters (corresponding to about 
one week of computations with our computers). Our findings are in favour 
of Bound A and are reported in Section 5. For large values of g, our bound 
provides the best value in the majority of cases. 

The only bound that we never beat is Plotkin's, but its range is very small 
(the distance has to be at least d > n{l — 1/q)) and the cases falling in this 
range are a tiny portion with large g's. 

For standard definitions and known bounds, the reader is directed to the 
original articles or to any recent good book, e.g. [HP03] or [PBH98]. 

2 Preliminaries 

We first recall a few definitions. 
Let ¥g be the finite field with q elements, where q is any power of any prime. 
Let n > k > 1 he integers. Let C C F^, C 7^ 0. We say that C is an (n, q) 
code. Any c G C is a word. Note that here and afterwards a "code" denotes 
what is called a "non-linear code" in the introduction. 

Let : (Fg)'^ — )■ (Fg)"" be an injective function and let C = lm(0). We say 
that C is an (n, k, q) systematic code if (f){v)i = Vi for any v G (Fg)*^ and 
any 1 < i < A;. If C is a vector subspace of (F^)", then C is a linear code. 
Clearly any non-zero linear code is equivalent to a systematic code. 
From now on, F will denote Fg and q is understood. 
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We denote with (c, c') the (Hamming) distance of two words c, c' G C, 
which is the number of different components between c and c' . We denote 
with d a number such that 1 < d < n to indicate the distance of a code, 
which is d = minc,c'GC,c^c'{(c, c')}. Note that a code with only one word has, 
by convention, distance equal to infinity. The whole F"' has distance 1, and 
d = n m. a, systematic code is possible only if /c = 1. 
From now on, ra, k are understood. 

Definition 2.1. Let I, m such that I <m. In F*", we denote by Bx{l,m) 
the set of vectors with distance from the word x less than or equal to I, and 
we call it the ball centered in x of radius I. 

For conciseness, B{l,m) denotes the ball centered in the zero vector. 
Obviously, B{l,m) is the set of vectors of weight less than or equal to / and 



We also note that any two balls having the same radius over the same field 
contain the same number of vectors. 

Definition 2.2. The number Aq{n,d) denotes the maximum number of words 
in a code over ¥g of length n and distance d. 

3 A first result for a special code family 

The maximum number of words in an (n, d) code can be smaller than 
Aq[n,d) if we have extra constraints on the weight of words. The following 
result is an example and it will be instrumental of the proof of Bound A . 

Theorem 3.1. Let C be an {n,d)-code over F". Let e > 1 be such that for 
any c E C we have w(c) > d + e. Then 



Proof. C belongs to the set of all codes with distance d and contained in 
F" \ Bo[d + e — 1, n). Let D be any code of the largest size in this set, then 



Clearly, any word c oi D has weight w(c) > d + e. Consider also D, the largest 
code over F" of distance d such that D C D. By definition, the only words of 
D of weight greater than d + e — 1 are those of D, while all other words of D 




j=0 




\C\<\D 



(1) 
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are confined to the ball BQ^d + e — l,n). Thus 

|<^| < 1^1 < 1^1 < (2) 

and 

D\D C Bo{d + e-l,n) 

Let p = d — 1 and r = d + e — 1, so that r — p = e, and let N = D H Bq^v, n). 
We have: 

D = D\N, \D\ = \D\-\N\ (3) 

We are searching for a lower bound on |A^|, in order to have an upper 
bound on \D\. We start with proving 

Bo{r-p,n) C |J 5,.(p,n) (4) 

Consider y G BQ{r — p,n). If for all x G we have that y ^ Bx{p,n), then 
y is a vector whose distance from is at least p + 1. Since y & Bo{r — p,n), 
also its distance from D\N is aX least p + 1. Therefore, the distance of y from 
the whole D is at least p + 1 = d and so we can obtain a new code D U {y} 
containing D and with distance d, contradicting the fact that |-D| is the largest 
size for such a code in F". So, (4) must hold. 
A direct consequence of (4) is 

\N\-\B,ip,n)\>\Boir-p,n)\, 

which gives 

I Yl > \Mr-p,n)\ _ |^o(e,n)| 

' ' - |5.(p,n)| \B,{d-l,n)\ ^ ' 

Using (1), (2), (3) and (5), we obtain the desired bound: 

|C| < \D\ = \D\ - \DnBo{d + e-l,n)\ 

\Bo{e,n)\ 



< Agin, (i) — , „ , , 



□ 



4 An improvement of the Litsyn-Laihonen bound 



In 1998 Litsyn and Laihonen prove a bound for non-linear codes: 
Theorem 1 of [LL98], which we write with our notation as follows. 
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Theorem 4.1 (Litsyn-Laihonen bound). Let 1 < d < n. Let t G N 6e such 
that t < n — d. Let r G N 6e such that d — 2r < n — t, < r <t and < r < ^d. 
Then 

Let C be an {n,d)-code over F, let k = Llogg(|C|)J. We say that C is 
systematic- embedding if C contains a systematic code D with size \D\ = q^. 
Obviously a systematic code is systematic-embedding with D = C. Moreover 
if the code is linear then k is the dimension of C. 

All known families of maximal codes are either systematic codes or systematic- 
embedding codes (see e.g., [Pre68], [Ker72] and [BvLW83]). 
We are ready to show a strengthening of Theorem 4.1 restricted to systematic- 
embedding codes: Bound A . In the proof we follow initially the outline of the 
proof of [LL98] [Theorem 1] and then we apply Theorem 3.1. 

Theorem 4.2 (Bound A). Let 1 < d < n. Let t e N be such that t <n — d. 
Let r G N 6e such that d — 2r<n — t,0<r<t and < r < ^d. Suppose that 
there is an {n,d)-code C overW such that \C\ = Aq{n,d) and C is systematic- 
embedding. Lett < k = [logg(|C|)J. Then 

. . ,x f . , , X \B{r,n-t)\ \ 

AJn, d) < , , AJn -t,d-2r)- , , ' ^ ' ^ ^ + 1 

' ^-\B{r,t)\\ ' ^ \B{d-2r -l,n-t)\ J 

Proof. We consider an {n,d) code C such that \C\ = Aq{n,d) and C is 
systematic-embedding. By hypothesis C must exist. We number all words in 
C in any order: C = {cj | 1 < i < Aq{n,d)}. 

We indicate the z-th word with Cj = (q^i, . . . , Cj^„). We puncture C as follows: 

(i) we choose any t columns among the k columns of the systematic part 
of C, 1 < ji, . . . , jt < n; since two codes are equivalent w.r.t. column 
permutations we suppose ji = 1, . . . ,jt = t. 

Let us split each word q G C in two parts 

Q ('-'«, 1; • • • ; ^i,t) (Cj^f-|_i, . . . , Cj^j^), SO Cj (Cj, Cj). 

(ii) We choose a z G F*. 

(iii) We collect in I all z's s.t. d{z, Ci) < r; 

(iv) We delete the first t components of {cj | i G /}. 

Then the punctured code Cz obtained by (i),(ii),(iii) and (iv) is: 

Cz = {ci \ i e 1} = {ci \ 1 < i < Aq{n, d), d{z, q) < r} 
We claim that we can choose z in such a way that Cz is equivalent to a code 
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with the following properties: 

n = n — t (6) 
d>d-2r (7) 

\C.\>^\B{r,t)\ (8) 

w{ci) >d-rioT all q 7^ (9) 

(6) is obvious. As regards (7), note that (q,Cj) = {ci,Cj) + {ci,Cj) > d and 
also that q, Cj G Bz{r, t) implies (q, Cj) < 2r. Therefore for any i j 

2r + (cj, Cj) > (q, Cj) + (ci, Cj) > d . 

The proof of (8) is more involved and we need to consider the average number 
M of the i's such that Cj happens to be in a sphere of radius r (in F*). The 
average is taken over all sphere centers, that is, all vectors x's in F*, so that 



F 

Let us define a function: 

7t XX Tn<t 



V':F*xF* — ^{0,1}, ^(x,?/) 



1, < r 

0, otherwise 



Then we can write M and \By{r,t)\ (for any ?/ G F*) as 
By swapping variables we get 

Aq{n,d) Aq{n,d) 



^ x6F' 1=1 ^ i=l x&t ^ 

This means that there exists a; G F* such that 



\{^\l<^< Ag{n,d),d, G B^{r,t)}\ >M> ^^^^J^ 1 5 (r, t) | . 

In other words, there are at least '^\B{r,t)\ Cj's such that their Cj's are con- 
tained in Bfi.{r,t). Distinct q's may well give rise to the same Cj's, but they 
always correspond to distinct q's (see the proof of (7)), so there are at least 
■L^|-B(r, t)| (distinct) q's such that their corresponding q's fall in Bx{r,t). By 
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choosing z = x we then have at least ^|i?(r, t)| (distinct) codewords of Cz 
and so (8) follows. 

We claim that (9) holds if G C and z = 0. Infact: 

w(c) = (0, c) > rf, Vc G C such that c 7^ 0. 
z = Q =^ y G Bz{r,t) <^==^ "w(?/) < r. 

As a consequence, any nonzero word Cj = (cj, q) of weight at most r in q has 
weight at least c? — r in the other n — t components. 

If ^ C or z 7^ we consider a code C + v equivalent to C, by choosing 
the translation v in the following way. By hypothesis of systematic-embedding 
there exists c G C such that its first t coordinates form the vector x. By con- 
sidering = c we obtain the desired code, thus (9) is proved. 

Now we call X the largest (n, d — 2r)-code containing the zero word and 
such that w(x) > d — r = {d — 2r) + r, Vx G X. Observe that X satisfies (6), 
(7), (8), (9) and so |X| > \Cz\- Then we can apply Theorem 3.1 to X \ {0} 
and e = r, and obtain the following chain of inequalities: 

i^|5(r,t)| < |C7,| < |X| < A,(n,c/-2r) \Bir,n)\ 



' ' \B{d-2r -l,n) 

and since \C\ = Aq{n, d) we have the bound: 



B{r,t)\ \ ' ' \B{d-2r -l,n)\ 

□ 

4.1 Systematic case 

When we restrict ourselves into the systematic/linear case, then the value 
Aq{n,d) can only be a power of g, and if the dimension of the code C is /c, 
then Aq{n, d) = q^. By choosing t = k we have the following corollary: 

Corollary 4.3 (Bound S). Let k,d,r e N.d > 2,k > 1. Let n he such that 
there exists an (n, fc, q) systematic code C with distance at least d. 
// < r < min{ [^J , k}, then 



\B{r,k)\ < Aq{n- k,d-2r) 



\B{r, n — k)\ 



\B{d-2r -l,n-k)\ 
In the systematic/linear case the Litsyn-Laihonen bound becomes: 
\B{r,k)\ < Aq{n- k,d-2r). 



Easy computations can be done in the case d = 3, since in this case r can be 
at most 1, so that: 
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• \B{l,k)\ = {q-l)k + l 

• Aq{n - k.d - 2r) = Aq{n - fc, 1) = g""*^ 

• \B{l,n-k)\ = {q-l){n-k) + l 

• \B{d-2r-l,n-k)\ = \B{0,n-k)\ = l 
Our bound then reduces to: 

< _ (g _ 1)^ _ 1 

which is stronger then the Litsyn-Laihonen bound, which in the case d = 3 
reduces to: 

< g"-'^ - (g - 1)A; - 1. 

5 Experimental comparisons with other upper bounds, remarks 
and conclusion 

We have analyzed the case of linear codes, implementing Bound S. The 
algorithm to compute the bound takes as inputs n, d, and returns the largest 
k (checks are done until k = n — d+1) such that the inequality of the bound 
holds. If the inequality always holds in this range, n — d+1 is returned. Then 
we compared our upper bound on k with other bounds, restricting those which 
hold in the general non-linear case to the systematic case. In particular they 
give a bound on Aq{n,d) instead of a bound on k. As a consequence, for 
example, if the Johnson bound returns the value Aq{n,d) for a certain pair 
{n,d), then we compare our bound with the value [\ogq{Ag{n,d))\, which is 
the largest power s of g such that g^ < Aq{n, d). 

The inequality in Theorem 4.3 involves the value Aq{n — k,d — 2r), which 
is the maximum number of words that we can have in a non-linear code of 
length n — k and distance d — 2r. To implement Bound !B it is necessary to 
compute Aq[n — k,d — 2r); when this value is unknown (we use known values 
only in the binary case for n = 3, . . . , 28, d = 3, . . . , 16), we return instead an 
upper bound on it, choosing the best between the Hamming (Sphere Packing), 
Singleton, Johnson, and Elias bound (the Plotkin bound is used when possi- 
ble). Even though it is a very strong bound, we do not use the Levenshtein 
bound because it is very slow as n grows. This means that if better values of 
Aq{n~k, d — 2r) can be found, then Bound !B could return even tighter results. 

Table 1 and 2 show a comparison between all bounds' performances, ex- 
cept for Plotkin's, due to its restricted range. For each bound and for each 
g = 2,3,4,5,7,8,9,11,13,16,17,19,23,25,27,29 we have computed, in the 
range n = 3, . . . , 100 and d = 3, . . . ,n — 1, the percentage of cases the bound 
is the "best" known bound between Bound 3, the Griesmer, Johnson, Lev- 
enshtein, Elias, Hamming and Singleton bound. Both wins and draws are 
counted in the percentage, since more than one bound may reach the best 
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known bound, and in this case we increased the percentage of each best bound. 
For each q the most performing bound is in bold. Up to g = 7 the Levenshtein 
bound is the most performing. From 9 < g < 29 we have that Bound !B is the 
most performing bound, and in particular, in the case g = 29, it is the best 
known bound almost 91% of the times. 

Table 3, instead, shows some cases (one per each q = 7, . . . , 29) where 
Bound T) beats all other known bounds. This happens from q = 7, for the 
range of n considered. The letters B, J, H, G, E, S and L stands respectively 
for Bound S, Johnson, Hamming (Sphere Packing), Griesmer, Elias, Single- 
ton, and Levenshtein bound. It can be seen that there are some cases where 
Bound !B is tight, as for the parameters (9, 17, 7), for which there exist a code 
with distance 10. 

Tables 4, and 5 give emphasis to the number of times Bound S improves 
the best known bound (thus the cases where it beats all other bounds). In the 
considered range Bound !B starts to beat all other bounds from q = 7. 
The third row of Tables 4 and 5 shows how many times (percentage over the 
number of draws and wins) the value 6 = pA^^T'""^''^ is different from zero. 
Informally, we can view 6 as the probability to randomly pick up a word of 
weight less than r from a ball of radius ci — 2r — 1. We can notice that this 
percentage is very high, which means that a weaker version of Bound S, which 
is similar to the Litsyn-Laihonen bound for systematic codes, could be used, 
by simply searching the largest k satisfying: 

\B{r,k)\ < Aq{n-k,d-2r) + l 

It is curious to notice that in all the wins we have 6 = 0, and that 6 = also 
38094 times over the 46967 ties and wins. This means that the weaker version 
of Bound S is sufficient to obtain most of the wins and ties in the investigated 
cases. 

We note that in general, if r is greater than d, we expect 6 big, decreasing very 
quickly as r increases, holding d fixed; this happens since \B{x,k)\ decreases 
following a gaussian distribution (roughly approximating \B{x, k)\ with a fac- 
torial), and so any time we subtract 2r the decrease is doubled. 
The fourth row of Tables 4 and 5 shows the ratio between the number of times 
the Plotkin bound has been used to bound Aq{n — k, d — 2r) and the number of 
draws and wins. Third and fourth row show values which are close for q small 
and gets further as q grows. This happens because almost all the times that 
the weaker version (with 5 = 0) of Bound S ties with the best known bound, 
a strong bound on Aq{n — k,d — 2r) must be used, and the strongest bound 
is Plotkin's, which though has a smaller range of applicability as q grows. 
We report in the fifth row of Tables 4 and 5 the fact that the maximum ratio 
d/n reached in the wins of Bound !B grows up to the value 0.64 and then seems 
to get stabilized toward 0.5. This means that Bound S is a very strong bound 
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for distances which are no more than | of the length n for small values of g, 
and no more than half of the length n for bigger values of q. 

Comparisons have been made using inner MAGMA ([MAG]) implementa- 
tions of known upper bounds, except for the Johnson bound. For this bound 
we noted that the inner MAGMA implementation could be improved and so 
we used our own MAGMA implementation for this bound. 
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The following tables show the results computed in the range n = 3, . . . , 100, 
d = 3, . . . ,n — 1. 



q 


2 


3 


4 


5 


7 


8 


9 


11 


Bound S 


38.02 


31.20 


31.20 


31.94 


40.73 


48.64 


55.27 


66.44 


Johnson 


40.65 


31.18 


33.50 


35.13 


35.70 


35.51 


35.09 


33.26 


Hamming 


18.12 


15.65 


16.37 


16.35 


16.03 


15.88 


15.57 


14.69 


Griesmer 


56.32 


39.83 


32.32 


29.14 


30.91 


36.97 


43.28 


55.15 


Levenshtein 


72.65 


69.68 


66.27 


64.02 


60.80 


58.24 


54.47 


46.26 


EUas 


6.859 


32.28 


38.27 


40.02 


40.82 


40.14 


37.24 


31.37 


Singleton 


0.000 


0.021 


0.084 


0.189 


0.610 


0.926 


1.241 


3.619 



Table 1 

When each bound is the best for 2 < q < 11. 



q 


13 


16 


17 


19 


23 


25 


27 


29 


Bound S 


76.43 


81.61 


82.75 


85.42 


88.11 


88.72 


89.40 


90.77 


Johnson 


30.80 


26.61 


24.87 


21.88 


17.08 


15.51 


14.37 


13.34 


Hamming 


13.59 


11.91 


11.26 


10.12 


8.269 


7.553 


7.048 


6.606 


Griesmer 


63.39 


71.91 


72.27 


71.94 


69.79 


69.43 


68.65 


67.87 


Levenshtein 


39.93 


32.86 


30.65 


27.50 


22.62 


20.70 


19.44 


18.37 


Elias 


27.06 


21.84 


20.01 


17.59 


12.48 


10.84 


9.657 


8.689 


Singleton 


4.439 


4.629 


6.985 


6.712 


10.08 


12.01 


14.12 


18.01 



Table 2 

When each bound is the best for 13 < q < 29. 
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q 


n 


d 


B 


J 


H 


G 


E 


S 


L 


7 


45 


21 


22 


23 


24 


23 


23 


25 


23 


8 


51 


24 


25 


27 


28 


26 


26 


28 


26 


9 


17 


7 


10 


11 


11 


11 


11 


11 


11 


11 


90 


55 


30 


41 


42 


32 


35 


36 


31 


13 


32 


9 


23 


24 


24 


24 


24 


24 


25 


16 


52 


14 


38 


39 


40 


39 


39 


39 


41 


17 


38 


9 


29 


30 


30 


30 


30 


30 


31 


19 


42 


9 


33 


34 


34 


34 


34 


34 


36 


23 


91 


17 


74 


75 


75 


75 


75 


75 


78 


25 


31 


5 


26 


27 


27 


27 


27 


27 


28 


27 


88 


24 


64 


66 


67 


65 


66 


65 


69 


29 


100 


29 


71 


74 


74 


72 


74 


72 


76 



Table 3 

Some cases where Bound 23 beats all the other bounds in the range 7 < q < 29. 



q 


2 


3 


4 


5 


7 


8 


9 


11 


Draws(D) (%) 


38.02 


31.20 


31.20 


31.94 


40.54 


47.59 


53.44 


64.80 


Wins(W) (%) 














0.1894 


1.052 


1.830 


3.955 


S = {% over 
D+W) 


44.67 


71.14 


61.77 


59.82 


68.75 


74.22 


79.71 


85.43 


Use of Plotkin 
(% over D+W) 


41.50 


69.52 


56.84 


51.98 


57.02 


61.16 


65.09 


68.57 


Maximum d/n 










0.47 


0.48 


0.52 


0.63 


in wins 


















Plotkin Range 

d/n 


0.50 


0.67 


0.75 


0.80 


0.87 


0.88 


0.89 


0.91 



Table 4 

Statistics for Bound S for 2 < g < 11. 
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Some bounds on the size of codes 





13 


16 


17 


19 


23 


25 


27 


29 


Draws(D) (%) 


73.11 


77.41 


78.48 


77.84 


73.43 


71.18 


69.60 


69.60 


Wins(W) (%) 


3.514 


4.208 


5.113 


7.574 


14.69 


17.55 


19.80 


21.19 


5 = {) {% over 
D+W) 


87.96 


88.45 


88.49 


88.28 


85.00 


83.02 


80.89 


78.62 


Use of Plotkin 
(% over D+W) 


65.54 


67.00 


66.09 


61.80 


55.16 


51.98 


48.98 


46.54 


Maximum d/n 


0.634 


0.640 


0.486 


0.487 


0.489 


0.490 


0.491 


0.492 


in wins 


















Plotkin Range 

d/n 


0.92 


0.94 


0.94 


0.95 


0.96 


0.96 


0.96 


0.97 



Table 5 

Statistics for Bound S for 13 < g < 29. 



